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Abstract. We consider two- player games played in real time on game structures with clocks and 
parity objectives. The games are concurrent in that at each turn, both players independently propose 
yV , a time delay and an action, and the action with the shorter delay is chosen. To prevent a player from 

winning by blocking time, we restrict each player to strategies that ensure that the player cannot be 
responsible for causing a zeno run. First, we present an efficient reduction of these games to turn-based 
(i.e., nonconcurrent) finite-state (i.e., untimed) parity games. The states of the resulting game are pairs 
of clock regions of the original game. Our reduction improves the best known complexity for solving 
timed parity games. Moreover, the rich class of algorithms for classical parity games can now be applied 
to timed parity games. 

Second, we consider two restricted classes of strategies for the player that represents the controller in 
a real-time synthesis problem, namely, limit-robust and bounded-robust strategies. Using a limit-robust 
Cj ' strategy, the controller cannot choose an exact real-valued time delay but must allow for some nonzero 

, 1 I jitter in each of its actions. If there is a given lower bound on the jitter, then the strategy is bounded- 

robust. We show that exact strategies are more powerful than limit-robust strategies, which are more 
powerful than bounded-robust strategies for any bound. For both kinds of robust strategies, we present 
efficient reductions to standard timed automaton games. These reductions provide algorithms for the 
synthesis of robust real-time controllers. 
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Timed automata [3] are models of real-time systems in which states consist of discrete locations and 
values for real-time clocks. The transitions between locations are dependent on the clock values. 
00 ! Timed automaton games [9, 1, 7, 12, 11] are used to distinguish between the actions of several players 

^^ ■ (typically a "controller" and a "plant"). We consider two-player timed automaton games with uj- 

regular objectives specified as parity conditions. The class of w-regular objectives can express all 
k><( I safety and liveness specifications that arise in the synthesis and verification of reactive systems, 

;h ' and parity conditions are a canonical form to express w-regular objectives [20]. The construction of 

a winning strategy for player 1 in such games corresponds to the controller- synthesis problem for 
real-time systems [10, 17, 22] with respect to achieving a desired w-regular objective. 

Timed automaton games proceed in an infinite sequence of rounds. In each round, both players 
simultaneously propose moves, with each move consisting of an action and a time delay after which 
the player wants the proposed action to take place. Of the two proposed moves, the move with the 
shorter time delay "wins" the round and determines the next state of the game. Let a set ^ of runs 
be the desired objective for player 1. Then player 1 has a winning strategy for ^ if she has a strategy 
to ensure that, no matter what player 2 does, one of the following two conditions hold: (1) time 
diverges and the resulting run belongs to <!>, or (2) time does not diverge but player-1's moves are 
chosen only finitely often (and thus she is not to be blamed for the convergence of time) [9, 14]. 
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af,a;<l ai,y>l^y:=0 

Fig. 1. A timed automaton game T. 

This definition of winning is equivalent to restricting both players to play according to receptive 
strategies [4, 19], which do not allow a player to win by blocking time. 

In timed automaton games, there are cases where a player can win by proposing a certain 
strategy of moves, but where moves that deviate in the timing by an arbitrarily small amount from 
the winning strategy moves lead to her losing. If this is the case, then the synthesized controller 
needs to work with infinite precision in order to achieve the control objective. As this requirement 
is unrealistic, we propose two notions of robust winning strategies. In the first robust model, each 
move of player 1 (the "controller") must allow some jitter in when the action of the move is taken. 
The jitter may be arbitrarily small, but it must be greater than 0. We call such strategies limit- 
robust. In the second robust model, we give a lower bound on the jitter, i.e., every move of player 1 
must allow for a fixed jitter, which is specified as a parameter for the game. We call these strategies 
bounded-robust. The strategies of player 2 (the "plant") are left unrestricted (apart from being 
receptive). We show that these types of strategies are in strict decreasing order in terms of power: 
general strategies are strictly more powerful than limit-robust strategies; and limit-robust strategies 
are strictly more powerful than bounded-robust strategies for any lower bound on the jitter, i.e., 
there are games in which player 1 can win with a limit-robust strategy, but there does not exist 
any nonzero bound on the jitter for which player 1 can win with a bounded-robust strategy. The 
following example illustrates this issue. 

Example 1. Consider the timed automaton 7 in Fig. 1. The edges denoted a\ for k G {1,2,3,4} 
are controlled by player 1 and edges denoted Og for j € {1,2,3} are controlled by player 2. The 
objective of player 1 is □(-i/^), ie., to avoid l^ . The important part of the automaton is the cycle 
f.,1^. The only way to avoid l'^ in a time divergent run is to cycle in between l^ and l^ infinitely 
often. In addition player 1 may choose to also cycle in between P and t^, but that does not help 
(or harm) her. Due to strategies being receptive, player 1 cannot just cycle in between l^ and l"^ 
forever, she must also cycle in between P and V", that is, to satisfy □(-i/'^) player 1 must ensure 
{nof') A (nO/-'^), where DO denotes "infinitely often". But note that player 1 may cycle in between 
l^ and t^ as many (finite) number of times as she wants in between an P , l^ cycle. 

In our analysis below, we omit such /^,/^ cycles for simplicity. Let the game start from the 
location f* at time 0, and let l^ be visited at time t^ for the first time. Also, let P denote the 
difference between times when l^ is visited for the j'-th time, and when f' is visited for the j'-th 
time. We can have at most 1 time unit between two successive visits to P , and we must have strictly 
more than 1 time unit elapse between two successive visits to l^. Thus, P must be in a strictly 
decreasing sequence. Also, for player 1 to cycle around f' and l^ infinitely often, we must have that 
all P > 0. Consider any bounded-robust strategy. Since the jitter is some fixed Ej, for any strategy 



of player 1 which tries to cycle in between P and l^, there will be executions where the transition 
labeled a\ will be taken when x is less than or equal to 1 — ej, and the transition labeled of will be 
taken when y is greater than 1 — Sj . This means that there are executions where P decreases by at 
least 2 • ffj in each cycle. But, this implies that we cannot having an infinite decreasing sequence of 
t-5"s for any Cj and for any starting value of t^. 

With a limit-robust strategy however, player 1 can cycle in between the two locations infinitely 
often, provided that the starting value of x is strictly less than 1. This is because at each step of 
the game, player 1 can pick moves that are such that the clocks x and y are closer and closer to 1 
respectively. A general strategy allows player 1 to win even when the starting value of x is 1. The 
details will be presented later in Example 3 in subsection 4.2. D 

Contributions. We first show that timed automaton parity games can be reduced to clas- 
sical turn-based finite-state parity games. Since the timed games are concurrent, in that in 
each turn both players propose moves before one of the moves is chosen, our reduction to 
the untimed turn based game generates states that are pairs of clock regions. The reduction 
allows us to use the rich literature of algorithms for classical parity games to solve timed 
automaton parity games. While a solution for timed automaton games with parity objec- 
tives was already presented in [9], our reduction obtains a better computational complexity; 
we improve the complexity from roughly O I (M • |C[ • |Ai[ • IA2I) • (16 • I^Regl) I to roughly 



O (m ■ \C\ ■ \A2\* ■ (32 • IS'Regl • M • |C| • \Ai\*)^^^\ where M is the maximum constant in the 
timed automaton, \C\ is the number of clocks, \Ai\ is the number of player-i edges, \Ai\* = 
min{[^.j[, |L| • 2' '}, \L\ is the number of of locations, I^Regl is the number of states in the re- 
gion graph (bounded by \L\ ■ Yix^c^'^^ + 1) • |C|! • 2''-'') , and d is the number of priorities in the 
parity index function. We note that the restriction to receptive strategies does not fundamentally 
change the complexity — it only increases the number of indices of the parity function by 2. 

Second, we show that timed automaton games with limit-robust and bounded-robust strategies 
can be solved by reductions to general timed automaton games (with exact strategies). The reduc- 
tions differentiate between whether the jitter is controlled by player 1 (in the limit-robust case), or 
by player 2 (in the bounded robust case). This is done by changing the winning condition in the 
limit-robust case, and by a syntactic transformation in the bounded-robust case. These reductions 
provide algorithms for synthesizing robust controllers for real-time systems, where the controller 
is guaranteed to achieve the control objective even if its time delays are subject to jitter. We also 
demonstrate that limit-robust strategies suffice for winning the special case of timed automaton 
games where all guards and invariants are strict (i.e., open). The question of the existence of a 
lower bound on the jitter for which a game can be won with a bounded-robust strategy remains 
open. 

Related work. A solution for timed automaton games with receptive strategies and parity ob- 
jectives was first presented in [9], where the solution is obtained by first demonstrating that the 
winning set can be characterized by a ^u-calculus fixpoint expression, and then showing that only 
unions of clock regions arise in its fixpoint iteration. Our notion of bounded-robustness is closely 
related to the Almost- AS AP semantics of [24] . The work there is done in a one-player setting where 
the controller is already known, and one wants the know if the composition of the controller and 
the system satisfies a safety property in the presence of bounded jitter and observation delay. A 
similar model for hybrid automata is considered in [2]. The solution for the existence of bounded 



jitter and observation delay for which a timed system stays safe is presented in [23]. Various models 
of robust timed automata (the one-player case) are also considered in [5, 6, 13, 15]. 

2 Timed Games 

In this section we present the definitions of timed game structures, runs, objectives, and strategies 
in timed game structures. 

Timed game structures. A timed game structure is a tuple S = (5, ^i, ^2) A)-^2) <^) with the 
following components. 

— 5" is a set of states. 

— Ai and A2 are two disjoint sets of actions for players 1 and 2, respectively. We assume that 
_Lj Ai, and write ^^ for ^jU{_Lj}. The set of moves for player i is Mj = lR>o x A^ \ 
Intuitively, a move {A, ai) by player i indicates a waiting period of A time units followed by a 
discrete transition labeled with action Oj. 

— -Tj : S* 1-^ 2 ' \ are two move assignments. At every state s, the set iKs) contains the moves 
that are available to player i. We require that (0, _Lj) G ri{s) for all states s ^ S and i G {1, 2}. 
Intuitively, (0, _Lj) is a time-blocking stutter move. 

— S : Sx (Ml UM2) 1-^ S* is the transition function. We require that for all time delays A, A' G ]R>o 
with A' < A, and all actions Ui (z A- \ we have (1) {A, ai) G ^Ks) iff both (Z\', _Lj) G i~i(s) and 
{A - Z\', ai) G ri((5(s, {A', U))); and (2) if 5{s, {A', U)) = s' and 6{s', {A - A', ai)) = s", then 
6{s,{A,ai)) = s". 

The game proceeds as follows. If the current state of the game is s, then both players simultaneously 
propose moves (Z\i, ai) G ri(s) and {A2, 02) G -^2(5). If ai 7^ _Li, the move with the shorter duration 
"wins" in determining the next state of the game. If both moves have the same duration, then the 
next state is chosen non-deterministically. If ai = _Li, then the move of player 2 determines the 
next state, regardless of Ai. We give this special power to player 1 as the controller always has the 
option of letting the state evolve in a controller-plant framework, without always having to provide 
inputs to the plant. Formally, we define the joint destination function (5jd : 5" x Mi x M2 1-^ 2'^ by 

({5is,{Ai,ai))} ifZ\i <Z\2 andai/±i; 

(5jd(s, (Z\i,ai),(Z\2,a2)) = < {(5(s, (Z\2, 02))} if ^2 < ^1 or ai = ±1; 

( {6{s, {A2,a2)),6{s, {Ai,ai))} if A2 = Ai and ai / ±1. 

The time elapsed when the moves mi = {Ai,ai) and 77x2 = (Z\2,a2) are proposed is given 
by delay(r?T,i,r?T,2) = min(Z\i, Z\2). The boolean predicate blamej(s,mi,?Ti2, s') indicates whether 
player i is "responsible" for the state change from s to s' when the moves rrii and m2 are proposed. 
Denoting the opponent of player i by ~i = 3 — i, for i G {1, 2}, we define 

h\amei{s,{Ai,ai),{A2,a2),s') = {Ai < A^i A 5{s,{Ai,ai)) = s') A (i = 1 ^ oi 7^ _Li) . 

Runs. A run of the timed game structure S is an infinite sequence r = sq, {m^, Tn2), si, (m}, 77X2), . . . 
such that Sk ^ S and m^ G i^Sfc) and Sk+i G djd{sk, rrii-, 1^2) fo^ all A; > and i G {1, 2}. For fc > 0, 
let time(r, fc) denote the "time" at position k of the run, namely, time(r, A;) = X^,=q delay(7?7.j,m2) 
(we let time(r, 0) = 0). By r[k] we denote the {k + l)-th state Sk of r. The run prefix r[0../c] is the 



finite prefix of the run r that ends in the state Sk- Let Runs be the set of all runs of S, and let 
FinRuns be the set of run prefixes. 

Objectives. An objective for the timed game structure S is a set 'P C Runs of runs. We will be 
interested in parity objectives. Parity objectives are canonical forms for cj-regular properties that 
can express all commonly used specifications that arise in verification. 

Let f2 : S ^^ {0, . . . , k — 1} he a parity index function. The parity objective for f2 requires that 
the maximal index visited infinitely often is even. Formally, let Inf0ften(i7(r)) denote the set of 
indices visited infinitely often along a run r. Then the parity objective defines the following set of 
runs: Parity(J7) = {r | max(lnfOften(J7(r))) is even }. A timed game structure S together with the 
index function i? constitute a parity timed game (of order k) in which the objective of player 1 is 
Parity (J7). 

Strategies. A strategy for a player is a recipe that specifies how to extend a run. Formally, a 
strategy vtj for player i € {1, 2} is a function ttj that assigns to every run prefix r[O..A;] a move rrii in 
the set of moves available to player i at the state r[k]. For i G {1, 2}, let TTj be the set of strategies 
for player i. Given two strategies tti G IIi and it2 € 172, the set of possible outcomes of the game 
starting from a state s € S is the set of possible runs denoted by Outcomes(s,7ri,7r2). 

Receptive strategies. We will be interested in strategies that are meaningful (in the sense that 
they do not block time). To define them formally we first present the following two sets of runs. 

— A run r is time-divergent if linifc^oo time(r, A;) = oo. We denote by Timediv is the set of all 
time-divergent runs. 

— The set Blameless^ C Runs consists of the set of runs in which player i is responsible only for 
finitely many transitions. A run sq, {m\,m^, si, (m}, 771-2), • • • belongs to the set Blamelessj, for 
i = {1, 2}, if there exists a /c > such that for all j > /c, we have -■ blamej(sj, rrij, 7722, Sj+i). 

A strategy ttj is receptive if for all strategies tt,.^,, all states s G S*, and all runs r G 
Outcomes(s,7ri,7r2), either r G Timediv or r G BlamelesSj. Thus, no what matter what the oppo- 
nent does, a receptive strategy of player i cannot be responsible for blocking time. Strategies that 
are not receptive are not physically meaningful. A timed game structure S is well-formed if both 
players have receptive strategies. We restrict our attention to well-formed timed game structures. 
We denote U^ to be the set of receptive strategies for player i. Note that for vri G i7{^,7r2 G 772 , 
we have Outcomes(s,7ri,7r2) C Timediv. 

Winning sets. Given an objective <^, let WinTimeDivj*(<^) denote the set of states s in S such 
that player 1 has a receptive strategy tti G U^ such that for all receptive strategies 1:2 G 7l|^, 
we have Outcomes(s,7ri,7r2) C ^. The strategy tt is said to be winning strategy. In computing the 
winning sets, we shall quantify over all strategies, but modify the objective to take care of time 
divergence. Given an objective ^, let TimeDivBli(c^) = (Timediv n ^) U (Blamelessi \ Timediv), i.e., 
TimeDivBli(^) denotes the set of runs such that either time diverges and ^ holds, or else time 
converges and player 1 is not responsible for time to converge. Let Winj'((p) be the set of states in 
S such that for all s G Winj'(c^), player 1 has a (possibly non-receptive) strategy vri G ili such that 
for all (possibly non-receptive) strategies 112 G il2) we have Outcomes(s,7ri,7r2) C #. The strategy 
TTi is said to be winning for the non-receptive game. The following result establishes the connection 
between Win and WinTimeDiv sets. 

Theorem 1 ([14]). For all well-formed timed game structures S? and for all to-regular objectives 
<P, we have Winj^(TimeDivBli(<^)) = WinTimeDivj^(#). 



We now define a special class of timed game structures, namely, timed automaton games. 

Timed automaton games. Timed automata [3] suggest a finite syntax for specifying infinite- 
state timed game structures. A timed automaton gam^e is a tuple T = (L, C, Ai, A2, E, 7) with the 
following components: 

— L is a finite set of locations. 

— C is a finite set of clocks. 

— Ai and A2 are two disjoint sets of actions for players 1 and 2, respectively. 

— E <^ L X {Ai U A2) X Constr(C) x L x 2"-^ is the edge relation, where the set Constr(C) of dock 
constraints is generated by the grammar 

e ::=x <d\d<x\^e\eiAe2 

for clock variables x £ C and nonnegative integer constants d. For an edge e = {l,ai,9,l' ,X), 
the clock constraint 9 acts as a guard on the clock values which specifies when the edge e can 
be taken, and by taking the edge e, the clocks in the set X Q C are reset to 0. We require that 
for all edges {l,ai,9',l' , X') 7^ {l,a^,9",l" ,X") G E, we have ai 7^ a'^. This requirement ensures 
that a state and a move together uniquely determine a successor state. 

— J : L >-^ Constr(C) is a function that assigns to every location an invariant for both players. All 
clocks increase uniformly at the same rate. When at location /, each player i must propose a 
move out of / before the invariant 7(/) expires. Thus, the game can stay at a location only as 
long as the invariant is satisfied by the clock values. 

A clock valuation is a function k : C >-^ IR.>o that maps every clock to a nonnegative real. The set 
of all clock valuations for C is denoted by K(C). Given a clock valuation k G K{C) and a time 
delay A € IR>o, we write k + A for the clock valuation in K{C) defined by {k + ^){x) = k{x) + A 
for all clocks x (z C. For a subset X Q C of the clocks, we write k[X := 0] for the clock valuation in 
K{C) defined by {k[X := 0])(x) = if x G A, and {k[X := 0])(a;) = Hi{x) if x A. A clock valuation 
K € K{C) satisfies the clock constraint 9 G Constr(C), written k\= 9, if the condition 9 holds when 
all clocks in C take on the values specified by k. A state s = {I, k.) of the timed automaton game T 
is a location / € L together with a clock valuation k € K{C) such that the invariant at the location 
is satisfied, that is, n \= 7(/). We let S be the set of all states of T. Given a timed automaton game 
T, the definition of a associated timed game structure [T] is standard [9] . 

Clock regions. Timed automaton games can be solved using a region construction from the 
theory of timed automata [3]. For a real t > 0, let frac(t) = t — [t\ denote the fractional part of t. 
Given a timed automaton game T, for each clock x G C, let c^ denote the largest integer constant 
that appears in any clock constraint involving x in T (let c^; = 1 if there is no clock constraint 
involving x). Two states (^i,ki) and {li,Ki) are said to be region equivalent if all the following 
conditions are satisfied: (a) li = I2, (b) for all clocks x, ki(x) < Cx iff K2(x) < Cx, (c) for all 
clocks X with Ki(x) < Cx, [ki(x)J = [k2(x)J, (d) for all clocks x,y with ki(x) < Cx and Ki{y) < Cy, 
frac(Ki(x)) < frac(Ki(x)) iff frac(K2(x)) < frac{K2ix)), and (e) for all clocks x with ki(x) < Cx, 
frac{Ki{x)) = iff frac(K2(a^)) = 0. A region is an equivalence class of states with respect to the 
region equivalence relation. There are finitely many clock regions; more precisely, the number of 
clock regions is bounded by \L\ ■ flxi^ci'-^^ + ^) ' 1^1' ' ^''"'• 

Region strategies and objectives. For a state s a S, we write Reg(s) C S for the clock region 
containing s. For a run r, we let the region sequence Reg(r) = Reg(r[0]), Reg(r[l]), • • • . Two runs 
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r, r' are region equivalent if their region sequences are the same. An a;-regular objective ^ is a region 
objective if for ah region-equivalent runs r, r', we have r G ^ iff r' € <^. A strategy vri is a region 
strategy, if for all runs ri and r2 and all A; > such that Reg(ri[0../i;]) = Reg(r2[0..A;]), we have that 
if 7ri(ri[0../c]) = (Z\,ai), then 7ri(r2[0..A;]) = (Z\',ai) with Reg(ri[A;] + A) = Reg(r2[/c] + A'). The 
definition for player 2 strategies is analogous. Two region strategies vri and vr^ are region-equivalent 
if for all runs r and all /c > we have that if 7ri(r[0..A;]) = (Z\,ai), then 7r'^(r[0..A;]) = (Z\',ai) 
with Reg(r[A;] + A) = Reg(r[A;] -|- A'). A parity index function i? is a region (resp. location) parity 
index function if fi{si) = fi{s2) whenever Reg(si) = Reg(s2) (resp. si,S2 have the same location). 
Henceforth, we shall restrict our attention to region and location objectives. 

Encoding time-divergence by enlarging the game structure. Given a timed automaton game 

T, consider the enlarged game structure 7 with the state space S '^ Sx lR[o,i) x {true, false}^, and 

an augmented transition relation 6 : S x (Mi UM2) 1-^ S. In an augmented state {s,^, tick, hli) G S, 
the component s € S* is a state of the original game structure [T] , 3 is value of a fictitious clock z 
which gets reset to every time it hits 1, tick is true iff z hit 1 at last transition and hli is true if 
player 1 is to blame for the last transition. Note that any strategy ttj in [T], can be considered a 
strategy in 7. The values of the clock z, tick and hli correspond to the values each player keeps in 
memory in constructing his strategy. Any run r in T has a corresponding unique run r in T with 
r[0] = (r[0], 0, FALSE, false) such that r is a projection of r onto 7. For an objective ^, we can now 
encode time-divergence as: TimeDivBli(<^) = (DO tick ^ ^) A (-iDO tick -^ OD^ bli). Let /? be a 
valuation for the clocks in C = C\J{z}. A state of Tcan then be considered as ((/,/?), tick, hli). We 
extend the clock equivalence relation to these expanded states: {{1,k) tick, hli) = {{1',k'), tick', hl'i) 
iff / = /', tick = tick' , hli = hl'i and k = k'. Given a location /, and a set A C C, we let i?[loc := 
/, A := 0] denote the region {{1,k) G S \ there exist /' and k' with (/',/?') G R and k(x) = if x G 
A,k(x) = /?'(x) if X A}. For every w-regular region objective ^ of 7, we have TimeDivBli(#) to 
be an w-regular region objective of T. 

We now present a lemma that states for region w-regular objectives region winning strategies 
exist, and all strategies region-equivalent to a region winning strategy are also winning. 

Lemma 1 ([8]). Let 7 he a timed automaton game and 7 he the corresponding enlarged game 
structure. Let (p he an uj -regular region objective of 7. Then, (1) there exists a region winning 
strategy for <1> from Wirii (#), and (2) ifir'i is a strategy that is region- equivalent to a region winning 
strategy vri, then tt'^ is a winning strategy for ^ from Wirii (^). 

3 Exact Winning of Timed Parity Games 

In this section we shall present a reduction of timed automaton games to turn-based finite game 
graphs. The reduction allows us to use the rich literature of algorithms for finite game graphs for 
solving timed automaton games. It also leads to algorithms with better complexity than the one 
presented in [9]. Let T be a timed automaton game, and let T be the corresponding enlarged timed 
game structure that encodes time divergence. We shall construct a finite state turn based game 
structure T-'^ based on regions of 7 which can be used to compute winning states for parity objectives 
for the timed automaton game T. In this finite state game, first player 1 proposes a destination 
region Ri together with a discrete action oi. Intuitively, this can be taken to mean that in the 
game 7, player 1 wants to first let time elapse to get to the region Ri, and then take the discrete 
action oi. Let us denote this intermediate state which specifies the desired region of player 1 in T'^ 
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by the tuple {R,Ri,ai). From this state in T-^, player 2 similarly also proposes a move consisting 
of a region R2 together with a discrete action 02- These two moves signify that player i proposed 
a move {Ai, ai) in T from a state 's £ R such that s + Z\j G Ri- The following lemma indicates that 
only the regions of s + Z\j are important in determining the successor region in T. 

Lemma 2 ([8]). Let 7 be a timed automaton gam^e and let Y,Y{,Y2 be regions in the enlarged 
timed game structure [T]. Suppose player-i has a move from si G y to s'l € Y' , for i £ {1,2}. 
Then, one of the following cases must hold. 

1. From all states 's £ Y , there exists a player-1 move m\ with 5{s,m\) G Y"/ such that for all 
moves m\ of player- 2 with 5(s, m|) G Y2, we have blamei(s, mf ,m2,<5(s, mf )) = true and 
blame2(s, mf,m2,(5(s, m^)) = false. 

2. From all states 's £Y, for all moves m\ of player-1 with 5{s,m\) G 1^, there exists a player-2 
move ml with (5(s, m^) G Y2 such that blame2(S', r?if ,7712, 5(s, ml)) = TRUE. 

By Lemma 2, given an initial state in i?, for moves of both players to some fixed Ri,R2, either 
the move of player 1 is always chosen, or player 2 can always pick a move such that player-1's move 
is foiled. Note that the lemma is asymmetric, the asymmetry arises in the case when time delays 
of the two moves result in the same region. In this case, not all moves of player 2 might work, but 
some will (e.g., a delay of player 2 that is the same as that for player 1). 

Let 5'Reg = {x I X is a region of 7}. Because of Lemma 2, we may construct a finite turn 
based game to capture the winning set. A finite state turn based game G consists of the tuple 
((5, £^), (S'l, 5*2)), where (S'l, S2) forms a partition of the finite set S of states, E is the set of edges, 
S'l is the set of states from which only player 1 can make a move to choose an outgoing edge, 
and S2 is the set of states from which only player 2 can make a move. The game is bipartite if 
every outgoing edge from a player-1 state leads to a player-2 state and vice-versa. A bipartite 
turn based finite game 7^ = {{S-l' ,E-l'),{SReg x {1},S'tup x {2})) can be constructed to capture 
the timed game 7 (the full construction can be found in the appendix). The state space S-^ equals 
'S'Reg X {1} U Sjup X {2}. The set Speg is the set of regions of T. Each {R, I) G SReg x {1} is indicative 
of a state in the timed game T that belongs to the region R. Each {Y, 2) G Sjup x {2} encodes the 
following information: (a) the previous state of T-^ (which corresponds to a region R of T), (b) a 
region R' of T (representing an intermediate state which results from time passage in 7 from a 
state in the previous region i? to a state in R'), and (c) the desired discrete action of player 1 to 
be taken from the intermediate state in R'. An edge from {R, 1) to (Y, 2) is represents the fact that 
in the timed game 7, from every state 's £ R, player 1 has a move (Z\,ai) such that s + Z\ is in 
the intermediate region component R' of {Y, 2), with ai being the desired discrete action. From the 
state {Y,2), player 2 has moves to SReg x {1} depending on what moves of player 2 in the timed 
game T can beat the player-1 moves from R to R' according to Lemma 2. 

Each Z G S-* is itself a tuple, with the first component being a location of 7. Given a location 
parity index function i? on T, we let Q-' be the parity index function on T-* such that f2^ {{I, •)) = 
i7((Z, •)). Another parity index function Qf with two more priorities can be derived from i?-^ to take 
care of time divergence issues, as described in [9]. Given a set X = Xi x {1} U X2 x {2} C S' , we 
let RegStates(X) = {sG S | Reg(s) G Xi). Theorem 2 shows that the turn based game T-^ captures 
the timed automaton game T. 



Theorem 2. Let 7 be an enlarged timed game structure, and let 7^ he the correspond- 
ing finite game structure. Then, given an to-regular region objective Parity (J7), we have 

Win7(TimeDivBli(Parity(J7))) = RegStates(Win7^(Parity(l?-^))). 

Proof. A solution for obtaining the set Win^ (TimeDivBli(Parity(i7))) has been presented in [9] 
using a /U-calculus formulation. The /U-calculus iteration uses the controllable predecessor opera- 
tor for player 1, CPrei : 2"^ i-^ 2"^, defined formally by s G CPrei(Z) iff 3mi € A(s) Vm2 G 
r2{s) . (Jjd(s^) "mi, 771,2) ^ Z. Informally, CPrei(Z) consists of the set of states from which player 1 can 
ensure that the next state will be in Z, no matter what player 2 does. It can be shown that CPrei 
preserves regions of T using Lemma 2. We use the Prei operator in turn based games: Prei(X) = 
{s G 5Reg X {1} I 3s' G X such that (s, s') G E^} U {s G ^jup x {2} [ V(s, s') G Ef we have s' G X}. 
From the construction of T-'^, it also follows that given X = Xi x {1} U X2 x {2} C S^ , we have 

RegStates(Pre7'^(Pref (X))) = CPre7(RegStates(X)) = CPre7(RegStates(Xi)) (1) 

Let (f)c be the /x-calculus formula using the CPrei operator describing the winning set for Parity(J7) = 
TimeDivBli(Parity(i7)) . Let (pt be the ^-calculus formula using the Prei operator in a turn based 
game describing the winning set for Parity(!7) . The formula </>t can be obtained from (pc by syntacti- 
cally replacing every CPrei by Prei. Let the winning set for Parity(i7) in T'^ be Wi x {1} U W2 x {2}. 
It is described by (pt- The game in T-' proceeds in a bipartite fashion — player 1 and player 2 alter- 
nate moves, with the state resulting from the move of player 1 having the same parity index as the 
originating state. Note that the objective Parity(i7) depends only on the infinitely often occurring 
indices in the trace. Thus, Wi x {1} can be also be described by the ;U-calculus formula 0j obtained 
by replacing each Prei in <Pt with Prei ° Pi'^i, and taking states of the form s x {1} in the result. Since 
we are only interested in the set I^i x {!}, and since we have a bipartite game where the parity index 
remains the same for every next state of a player-1 state, the set Wi x {1} can also be described by 
the ^-calculus formula (j)'l obtained from (j)[ by intersecting every variable with ^Reg x {!}. Now, (j)'l 
can be computed using a finite fixpoint iteration. Using the identity 1, we have that the sets in the 
fixpoint iteration computation of (j)'l correspond to the sets in the fixpoint iteration computation of 
0c, that is, if X X {1} occurs in the computation of (p'l at stage j, then RegStates(X) occurs in the 
computation of (j)'l at the same stage j. This implies that the sets are the same on termination for 
both (t)'l and (pc- Thus, Win?'(TimeDivBli(Parity(i7))) = RegStates(Win7^(Parity(i?-^))). D 

The state space of the finite turn based game can be seen to be at most 0(|S'RegP • \L\ ■ 21*^1) 
(a discrete action may switch the location, and reset some clocks). We show that it is not required 
to keep all possible pairs of regions, leading to a reduction in the size of the state space. This is 
because from a state s G i?, it is not possible to get all regions by letting time elapse. 

Lemma 3. Let 7 be a timed automaton game, T the corresponding enlarged game structure, and 
R a region in 7. The number of possible time successor regions of R are at most 2 • ^^g^; '^{cx + 
1) < 4 • (M + 1) • [\C\ + 1), where Cx is the largest constant that clock x is compared to in 7, 
M = maxjca; | x G C} and C is the set of clocks in 7. 

Complexity of reduction. Recall that for a timed automaton game T, Ai is the set of actions for 
player i, C is the set of clocks and M is the largest constant in 7. Let \Ai\* = min{[^j[, \L\ ■ 2' '} 
and let |Tconstr| denote the length of the clock constraints in 7. The size of the state space of T'^ 

9 



is bounded by j^Regl • (1 + (M + 1) • (|C| + 2) • 2 • (I^i|* + 1)), where I^Regl < 16 • \L\ ■ Uxed^^ + 
1) • |C + 1|! • 21*^1+-'^ is the number of regions of T. The number of edges in T'^ is bounded by |5'Reg| • 
((M + 1) • (1C| + 2) • 2) • (l^il* + 1) [(1 + {\A2\* + 1) • ((M + 1) • {\C\ + 2) • 2)]. See the appendix for 
details. 

Theorem 3. Let 7 be a timed automaton gam.e, and let Q he a region parity index function of 
order d. The set WinTimeDiV]^ (Parity(J7)) can he computed in time 

( d+2 I 3 \ 

(I^Reg|-|Tconstr|) + [M.|C|-|^2r]-[2-|5Reg|-M.|C|-|AirJ ' M 

where |5'Reg[ < 16 • \L\ ■ Ylx^c^'^'-^ + 1) • |C + 1[! • 21*^1+-^, M is the largest constant in 7, |Tconstr| is 
the length of the clock constraints in 7, C is the set of clocks, \Ai\* = min{|ylj|, \L\ • 21*^1}, and \Ai\ 
the number of discrete actions of player i for i G {1, 2} . 

In Theorem 3, we have used the result from [18] which states that a turn based parity game 
with m edges, n states and d parity indices can be solved in 0(r7T,-na"''2) time. From Theorem 2, we 
can solve the finite state game 7^ to compute winning sets for all w-regular region parity objectives 
^ for a timed automaton game T, using any algorithm for finite state turn based games, e.g., 
strategy improvement, small-progress algorithms [21,16]. Note that T-'^ does not depend on the 
parity condition used, and there is a correspondence between the regions repeating infinitely often 
in 7 and 7^ . Hence, it is not required to explicitly convert an w-regular objective ^ to a parity 
objective to solve using the T-' construction. We can solve the finite state game T'' to compute 
winning sets for all w-regular region objectives <^, where <? is a Muller objective. Since Muller 
objectives subsume Rabin, Streett (strong fairness objectives), parity objectives as a special case, 
our result holds for more a much richer class of objectives than parity objectives. 

Corollary 1. Let 7 he an enlarged timed game structure, and let T-' he the corresponding finite 
game structure. Then, given an co-regular region objective (p, where ^ is specified as a Muller 
objective, we have Win7(TimeDivBli(<^)) = RegStates(Win7''(TimeDivBli(#))). 

4 Robust Winning of Timed Parity Games 

In this section we study restrictions on player- 1 strategies to model robust winning, and show how 
the winning sets can be obtained by reductions to general timed automaton games. The results of 
Section 3 can then be used to obtain algorithms for computing the robust winning sets. 

There is inherent uncertainty in real-time systems. In a physical system, an action may be 
prescribed by a controller, but the controller can never prescribe a single timepoint where that 
action will be taken with probability 1. There is usually some jitter when the specified action is 
taken, the jitter being non-deterministic. The model of general timed automaton games, where 
player 1 can specify exact moves of the form {A, ai) consisting of an action together with a delay, 
assume that the jitter is 0. In subsection 4.1, we obtain robust winning sets for player 1 in the 
presence of non-zero jitter (which are assumed to be arbitrarily small) for each of her proposed 
moves. In subsection 4.2, we assume the the jitter to be some fixed ej > for every move that is 
known. The strategies of player 2 are left unrestricted. In the case of lower-bounded jitter, we also 
introduce a response time for player-1 strategies. The response time is the minimum delay between 
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a discrete action, and a discrete action of the controller. We note that the set of player-1 strategies 
with a jitter of ej > contains the set of player-1 strategies with a jitter of e-J1 and a response 
time of ej/2. Thus, the strategies of subsection 4.1 automatically have a response time greater than 
0. The winning sets in both sections are hence robust towards the presence of jitter and response 
times. 

4.1 Winning in the Presence of Jitter 

In this subsection, we model games where the jitter is assumed to be greater than 0, but arbitrarily 
small in each round of the game. 

Given a state s, a limit-robust move for player 1 is either the move {A, _Li) with {A, _Li) G A(s); 
or it is a tuple {[a,(3],ai) for some a < f3 such that for every A £ [ct,f3] we have (Z\,ai) G A(s)- 
^ Note that a time move (Z\,_Li) for player 1 implies that she is relinquishing the current round 
to player 2, as the move of player 2 will always be chosen, and hence we allow a singleton time 
move. Given a limit-robust move m,robi for player 1, and a move m2 for player 2, the set of possible 
outcomes is the set {Sjdis,mi,m2) \ either (a) m^robi = (Z\,±i) andmi = m^robi; or (b) m^robi = 
{[a,P],ai) and mi = {A,ai) with A G [a,/3]}. A lim,it-robust strategy -ir[°^ for player 1 prescribes 
limit-robust moves to finite run prefixes. We let n[°^ denote the set of limit-robust strategies 
for player-1. Given an objective (p, let RobWinTimeDiV]^ (^) denote the set of states s in T such 
that player 1 has a limit-robust receptive strategy 7rJ° G i7{^ such that for all receptive strategies 
'7r2 G n^, we have Outcomes(s, vrj°'', 712) C (p. We say a limit-robust strategy vr^"'' is region equivalent 
to a strategy tti if for all runs r and for all A; > 0, the following conditions hold: (a) if 7ri(r[0..fc]) = 
(Z\,±i), then 7r[°^{r[0..k]) = (Z\',±i) with Reg{r[k] + A) = Reg{r[k] + A'); and (b) if 7ri(r[0..fc]) = 
(Z\,ai) with ai 7^ _Li, then 7r;°''(r[0..A;]) = {[a,p],ai) with Reg(r[A;] + A) = Reg(r[fc] + A') for all 
A' G [a,/?]. Note that for any limit-robust move {[a,(3],ai) with oi 7^ _Li from a state s, we must 
have that the set {s + Z\ | Z\ G [a, (3]} contains an open region of T. 

We now show how to compute the set RobWinTimeDiv^ (c^). Given a timed automaton game 
T, we have the corresponding enlarged game structure 7 which encodes time-divergence. We add 
another boolean variable to T to obtain another game structure Trob- The state space of Trob is S" x 
{true, false}. The transition relation Smb is such that 5rohi(s, fbi), {A,ai)) = ((5(s, (Z\,ai)), rb'i), 
where rb'i = TRUE iff rbi = true and one of the following hold: (a) Oj G A2', or (b) Oj = _Li; or 
(c) tti G Ai and s + A belongs to an open region of T. 

Theorem 4. Given a state s in a timed automaton game T and an uj -regular region objective ^, 

we have s G RobWinTimeDiv7(^) iif (s, •,-,•, true) G Win^'"°''(<^ A □(r6i = true) A {Oa(tick = 
false) -^ {Oa[bli = false)))). 

Proof. 1. (=^) Suppose player-1 has a limit-robust receptive strategy winning strategy vri for 'P. 

starting from a state s in 7. we show {s, •, •, •, true) G W\iy['°^{(P A □(r6i = true) A {Oa[tick = 
false) -^ {On(bli = false)))). 

We may consider tti to be a strategy in T. Since vri is a limit-robust strategy, player-1 proposes 
limit-robust moves at each step of the game. Given a state s, and a limit-robust move {[a, (3],ai), 
there always exists a < a' < (3' < f3 such that for every A G [a' , /3'], we have that s'+ A belongs 
to an open region of T. Thus, given any limit-robust strategy vri, we can obtain another limit- 
robust strategy vr^ in T, such that for every k, (a) if vri (r[/c]) = {A, ±1), then TT[{r[k]) = 7ri(r[A;]); 



^ We can alternatively have an open, or semi-open time interval, the results do not change. 
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and (b) if 7ri(r[fc]) = ([a,/3],ai), then <(r[A;]) = ((Z\,ai) with A G [a',/?'] C [a,/3], and 
{r[fc]+Z\' I A' € [a', /3']} being a subset of an open region of T. Thus for any strategy 112 of player- 
2, and for any run r G Outcomes((s, •, •, •, true), vr^, 7r2), we have that r satisfies □(r6i = true). 
Since vri was a receptive winning strategy for ^, tt^ is also a receptive winning strategy for $. 
Hence, r also satisfies <P A <>U[tick = false) -^ (On (6/1 = false). 

2. (^) Suppose (s, •,-,•, true) G WinJ^™^(# A □(r6i = true) A {OU{tick = false) ^ (On(Wi = 
false)))). We show that player- 1 has a limit-robust receptive winning strategy from state 
s. Let VTi be a winning region winning strategy for player-1 for the objective ^ A □(r6i = 
true) a {<>U[tick = false) -^ (on (6/1 = false))). For every run r starting from state 
(s, •,-,•, true), the strategy vri is such that 7ri(r[0..A;]) = {A^,a\) such that either a\ = ±1, or 
r[k] + A^ belongs to an open region R of S Since R is an open region, there always exists some 
a < P such that for every A € [a,/3], we have r[k] + A ^ R. Consider the strategy ttJ"*^ that 
prescribes a limit-robust move ([a,/3],a^) for the history r[0../i;] if 7ri(r[0..A;]) = {A^,ai) with 
a^ 7^ J-i, and 7r^°'^(r[0..fc]) = 7ri(r[0..fc]) otherwise. The strategy n'^^ is region-equivalent to vri, 
and hence is also winning for player-1 by a lemma similar to Lemma 1 (see Lemma 4 in the 
appendix). Since it only prescribes limit-robust moves, it is a limit-robust strategy. And since 
it ensures OD[tick = false) -^ (On(6/i = false), it is a receptive strategy. 

D 

We say a timed automaton T is open if all the guards and invariants in T are open. Note that 
even though all the guards and invariants are open, a player might still propose moves to closed 
regions, e.g., consider an edge between two locations /i and I2 with the guard < x < 2; a player 
might propose a move from {li,x = 0.2) to {l2,x = 1). The next theorem shows that this is not 
required of player 1 in general, that is, to win for an a;-regular location objective, player 1 only needs 
to propose moves to open regions of T. Let Constr*(C) be the set of clock constraints generated by 
the grammar 

6'::=x<d|x>d|a;>0|a;<y|6'iA6'2 

for clock variables x,y £ C and nonnegative integer constants d. An open polytope of 7 is set of 
states X such that X = {(/, k) G S \ k \= 6} for some 6 € Constr*(C). An open polytope X is hence 
a union of regions of T. Note that it may contain open as well as closed regions. We say a parity 
objective Parity(i7) is an open polytope objective if f2^^{j) is an open polytope for every j > 0. 

Theorem 5. Let T be an open timed automaton game and let (P = Parity(J7) be an uj-regular 
location objective. Then, WinTimeDivj^(^) = RobWinTimeDiv7(^). 

Proof. We present a sketch of the proof. We shall work on the expanded game structure T*^" , 

and prove that (s, •,-,•, true) G W\nl'°^{<P A □(r6i = true) A {OU{tick = false) —> {<}U{bli = 

false)))) iff (s, •, •, •,true) G Wm1'°^{<P A {On{tick = false) -^ {Oa{bli = false)))). The desired 
result will then follow from Theorem 4. 

Consider the objective TimeDivBli(^) = <P ^ {OU{tick = false) —> {<}n{bli = false))). Let Q 
be the parity index function such that Parity(J7) = TimeDivBli(<^). Since <^ is a location objective, 
and all invariants are open, we have Q~^{j) to be an open polytope of T™ for all indices j > 
(recall that a legal state of T must satisfy the invariant of the location it is in). 

The winning set for a parity objective Parity(i7) can be described by a ^-calculus for- 
mula, we illustrate the case for when Q has only two priorities. The ^-calculus formula is 
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then: fiYuX (i?"^!) ^ CPrei(y)) U (12^^(0) n CPrei(X)) . This set can be computed from a (fi- 
nite) iterative fixpoint procedure. Let Y* = fiYuX [(i?"^(l) n CPrei(F)) U (^^^0) ^ CPrei(X))] . 
The iterative fixpoint procedure computes Yq = (!> Q Yi C ••• Q Yn = Y* , where Yi-^^i = 
uX[{n-\l)nCPrei{Yi))U{Q-^{0)nCPrei{X))]. We claim that each Yi for i > is a union 
of open polytopes of T*^" . This is because (a) the union and intersection of a union of open poly- 
topes is again a union of open polytopes, and (b) uX{A U (S n CPrei(X))) is an open polytope 
provided A, B are open polytopes, and T is an open timed automaton game. We can consider the 
states in Yi \ Yi^i as being added in two steps, T2i-i and T2i{= Yi) as follows: 

1- T2i-i = Q'^{1) n CPrei(yj_i). T2i-i is clearly a subset of Y^. 

2. T2i = vX Vr2i-i U (^^-^0) n CPrei(X))] . Note (Tsi \ T2i-i) n J7-i(l) = 0. 

Thus, in odd stages we add states with index 1, and in even stages we add states with index 0. The 
rank of a state s G y* is j if s G Tj \ U^^qT^. Each rank thus consists of states forming an open 
polytope. A winning strategy for player 1 can also be obtained based on the fixpoint iteration. The 
requirements on a strategy to be a winning strategy based on the fixpoint schema are: 

1. For a state of even rank j, the strategy for player 1 must ensure that she has a move such that 
against all moves of player 2, the next state either (a) has index and belongs to the same rank 
or less, or (b) the next state has index 1 and belongs to rank smaller than j. 

2. For a state of odd rank j, the strategy for player 1 must ensures that she has a move such that 
against all moves of player 2, the next state belongs to a lower rank. 

Since the rank sets are all open polytopes, and T is an open timed automaton, we have that there 
exists a winning strategy which from every state in a region i?, either proposes a pure time move, or 
proposes a move to an open region (as every open polytope must contain an open region). Hence, 
this particular winning strategy also ensures that □(r6i = true) holds. Thus, this strategy ensures 
TimeDivBli(^) A □(r6i = true). The general case of an index function of order greater than two 
can be proved by an inductive argument. D 

4.2 Winning with Bounded Jitter and Response Time 

The limit-robust winning strategies described in subsection 4.1 did not have a lower bound on the 
jitter: player 1 could propose a move ([a, a-|-e], ai) for arbitrarily small a and e. In some cases, the 
controller may be required to work with a known jitter, and also a finite response time. Intuitively, 
the response time is the minimum delay between a discrete action and a discrete action of the 
controller. We model this scenario by allowing player 1 to propose moves with a single time point, 
but we make the jitter and the response time explicit and modify the semantics as follows. Player 1 
can propose exact moves (with a delay greater than the response time), but the actual delay in the 
game will be controlled by player 2 and will be in a jitter interval around the proposed player- 1 
delay. 

Given a finite run r[O..A;] = so,{mi,m2),si,{m\,m2), ■ ■ ■ ,Sk, let TimeElapse(r[O..A;]) = 
Si=n delay(m{, 771-2) where p is the least integer greater than or equal to such that for all k > j > p 
we have 7722 = {A2, -\-2) and h\ame2{sj,m\,m2,Sj^i) = true (we take TimeElapse(r[0..fc]) = if 
p = k). Intuitively, TimeElapse(r[O..A;]) denotes the time that has passed due to a sequence of 
contiguous pure time moves leading upto s^. in the run r[0../c]. Let ej > and Sr ^ be given 
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bounded jitter and response time (we assume both are rational). Since a pure time move of player 1 
is a relinquishing move, we place no restriction on it. Player 2 can also propose moves such that 
only time advances, without any discrete action being taken, in this case, we need to adjust the 
remaining response time. Formally, an e^-jitter Sr-response bounded-robust strategy tti of player 1 
proposes a move 7ri(r[0..A;]) = mj^ such that either 

- m'l = (Z\^±l) with (Z\,±i) G ri(5), or, 

— m^ = (Z\ , ai) such that the following two conditions hold: 

• A'' > max(0, Er — TimeElapse(r[0../c])), and, 

• {A', ai) G ri(s) for ah A' G [Z\^ A'' + Ej]. 

Given a move rrii = {A,ai) of player 1 and a move m2 of player 2, the set of resulting states is 
given by (5jd(s,mi, 77x2) if oi = ±1, and by {(5jci(s,mi + e, 771,2) I e G [0, ej]} otherwise. Given an 
Cj-jitter Cr-response bounded-robust strategy vri of player 1, and a strategy tt2 of player 2, the set 
of possible outcomes in the present semantics is denoted by OutcomeSjv(s,7ri,7r2). We denote the 

winning set for player 1 for an objective 'P given finite ej and e,- by JRWinTimeDiV]^' " '{^). We now 
show that JRWinTimeDiV]^' ■'' ' {^) can be computed by obtaining a timed automaton T^j''^'" from T 

such that WinTimeDivf''''(^) = JRWinTimeDiv5^'''^'^X^). 

Given a clock constraint 99 we make the clocks appearing in ip explicit by denoting the con- 
straint as (/?( a: ) for X = [xi, . . . ,x„]. Given a real number 5, we let (p{x +6) denote the clock 
constraint ip' where (p' is obtained from (p by syntactically substituting Xj + 6 for every oc- 
currence of Xj in ip. Let /^J : Constr(C) 1-^ Constr(C) be a function defined by /^J ((/?( x )) = 
ElimQuant (V(5 {0 < 5 < e-^ ^ <p{ x + 5))), where ElimQuant is a function that eliminates quantifiers 
(this function exists as we are working in the theory of reals with addition, which admits quantifier 
elimination). The formula /^■'(v) ensures that (p holds at all the points in { x + Z\ | Z\ < ej}. 

We now describe the timed automaton 7^''^'. The automaton has an extra clock z. The set of 
actions for player 1 is {(l,e) | e is a player-1 edge in T} and for player 2 is ^2 U {{02, e) \ 02 G 
A2 and e is a player-1 edge in T} U {(2, e) | e is a player-1 edge in T} (we assume the unions are 
disjoint). For each location I of T with the outgoing player-1 edges e\, . . . , e™, the automaton 'J'"''^' 
has m + 1 locations: l,l^i, . . . , le"^- Every edge of T'^j'^'- includes z in its reset set. The invariant for 
/ is the same as the invariant for I in 7. All player-2 edges of T are also player-2 edges in 7^''^' 
(with the reset set being expanded to include z). The invariant for l^^ is z < ej. If (/, 02, (/?,/', A) 
is an edge of 7 with 02 G A2, then then {1^^, {a2,ej),ip,l',X U {z}) is a player-2 edge of 7^''^^' for 
every player-1 edge Cj of T. For every player-1 edge Sj = {I, a\, ip, I' , A) of 7, the location / of T^J'^'' 
has the outgoing player-1 edge {I, (l,ej),/^J (7^(0) A (z > Er) A /^j ((/?), /gj, A U {z}). The location 
lej also has an additional outgoing player-2 edge {le^, {2,ej),ip,l' , XU {z}). The automaton T'^j'^'- 
as described contains the rational constants e^ and ej. We can change the timescale by multiplying 
every constant by the least common multiple of the denominators of e^ and ej to get a timed 
automaton with only integer constants. Intuitively, in the game 7^'"^^' , player 1 moving from I to 
lej with the edge (1,6^) indicates the desire of player 1 to pick the edge Cj from location I in the 
game 7. This is possible in T iff the (a) more that e^ time has passed since the last discrete action, 
(b) the edge Cj is enabled for at least ej more time units, and (c) the invariant of / is satisfied for at 
least ej more time units. These three requirements are captured by the new guard in 7^''^', namely 
f^' (7^(0) A (z > er) A /^J ((/?). The presence of jitter in 7 causes uncertainty in when exactly the 
edge Cj is taken. This is modeled in 7^'''^' by having the location l^ be controlled entirely by player 2 
for a duration of ej time units. Within ej time units, player 2 must either propose a move (02, e^) 
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al,x > 2 ^ z ~0 




(a2,e2o), 
Fig. 2. The timed automaton game T'^J''^' obtained from T. 



(corresponding to one of its own moves 02 in T, or allow the action {2,ej) (corresponding to the 
original player-1 edge Cj) to be taken. Given a parity function Q"^ on T, the parity function i? is 
given by i? (/) = i? (/g ) = f^ (l) for every player-1 edge Sj of T. In computing the winning 
set for player 1, we need to modify blamei for technical reasons. Whenever an action of the form 
(1, Cj) is taken, we blame player 2 (even though the action is controlled by player 1); and whenever 
an action of the form {2,ej) is taken, we blame player 1 (even though the action is controlled by 
player 2). Player 2 is blamed as usual for the actions (02, Cj). This modification is needed because 
player 1 taking the edge ej in 7 is broken down into two stages in T'^j'^^ If player 1 to be blamed 
for the edge (l,ej), then the following could happen: (a) player 1 takes the edge (l,ej) in 7^i'^' 
corresponding to her intention to take the edge Cj in T (b) player 2 then proposes her own move 
{a2,ej) from Ig., corresponding to her blocking the move Sj by 02 in T. If the preceeding scenario 
happens infinitely often, player 1 gets blamed infinitely often even though all she has done is signal 
her intentions infinitely often, but her actions have not been chosen. Hence player 2 is blamed for 
the edge (1, e^). If player 2 allows the intended player 1 edge by taking (2, Cj), then we must blame 
player 1. We note that this modification is not required if e^ > 0. 



Example 2 (Construction of 7^''^' ). An example of the construction is given in Figure 2, corre- 
sponding to the timed automaton of Figure 1. The location l^ is an absorbing location — it only 
has self- loops (we omit these self loops in the figures for simplicity) . For the automaton T, we have 
Ai = {a\, af, af, af} and A2 = {02, a^, af}. The invariants of the locations of T are all true. Since 
7 at most a single edge from any location P to l^, all edges can be denoted in the form Sjk- The set 
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of player-1 edges is then {eoi, eo2, 620, eio}. The location /^ has been rephcated for ease of drawing 
in T^j•'^^ Observe that f^'^x < 1) = x < 1 - Ej and f'^'{y > 1) = y > 1 - ej. D 

The construction of T'^j''^'' can be simphfied if Sj = (then we do not need locations of the form /g .). 

Given a set^f states S of T'^J'^'', let JStjtes(S') denote the projection of states to T, defined formally 
by JStates(S') = {{1,k) G S \ {1,k) G S such that k{x) = k{x) for all x G C}, where S is the state 
space and C the set of clocks of T. 

Theorem 6. Let 7 be a timed automaton game, e^ >0 the response time of player 1, and Ej > the 
jitter of player 1 actions such that both e^ and e^ are rational constants. Then, for any to-regular lo- 
cation objective Parity(i7'^) of 7, we have JStates [ |z = 0] n WinTimeDiv^^' '(Parity(i7'^''' ')) j = 

JRWinTimeDiv^' ■'' '(Parity(i7 )), where JRWinTimeDivj^' ■'' '(#) is the winning set in the jitter- 
response semantics, ^^i'^' is the timed automaton with the parity function i? described above, and 
\z = 0] is the set of states of 7^''^' with /?(z) = 0. 

Example 3 (Differences between various winning modes). Consider the timed automaton T in Fig. 1. 
Let the objective of player 1 be n(-i^^), ie., to avoid l^. The important part of the automaton is the 
cycle l^ , l^. The only way to avoid l^ in a time divergent run is to cycle in between f' and /^ infinitely 
often. In additional player 1 may choose to also cycle in between l^ and t^, but that does not help (or 
harm) her. In our analysis, we omit such Z*^, t^ cycles. Let the game start from the location l^ . In a run 
r, let t\ and tg be the times when the a}-th transition and the af-th transitions respectively are taken 
for the j'-th time. The constraints are t\ — t{~ < 1 and ^2 ~ ^2~ > 1- If the game cycles infinitely 
often in between l^ and l^ we must also have that for all j > 0, t{ > ^2 — *!• ^^ ^^^° have that if 
this condition holds then we can construct an infinite time divergent cycle of l^ , l^ for some suitable 
initial clock values. Observe that t^ = t^^+{t]-t^) + {tl-t])^ K(ii-*i~^) fori € {1,2}. We need 

t^+i-t^ = (t^+^-tf ) + E}li {{A - t{'^) - {t{ - tr^)} + (*i-*2) > for all m > 0. Rearranging, 
we get the requirement XlJLi {(4 " 4~^) " (4 " A'^)\ < (C"^^ - t?) + (*i " *2)- Consider the 
initial state (/°,x = y = 0). Let t? = l,t^ = 1.1, tj - t{~^ = 1,4 - 4"^ = 1 + 10"(-'+^). We have 

ET=i {(4 - r ') - (A - ii~')} < ET=i 10"^'+'^ = 10-^ * 0^ < 1 - 0.1 = {tr' - tf) + (t? - 1%). 

Thus, we have an infinite time divergent trace with the given values. Hence {l^,x = y = 0) € 
WinTimeDiv7(n(-'Z^)). It can also be similarly seen that {l^,x = y = 1) G WinTimeDivi(n(-iZ^)) 
(taking t? = and t^ = 0.1). 

We now show {f,x = y = 0) £ RobWinTimeDivi(n(^/-'^)). Consider t? G [0.9, 1],^ - 
t{~^ G [1 - 10-(-'+i),l],t^ G [1.05, 1.1], 4 - 4"^ e [1 + 0.5 * 10^(^+1), 1 + 10^(^+1)]. We have 

ET=i {(4 - tl') - (4 - 4^')} < ET=i io-(^+i)-(-io-(^+i)) < 2*E°li w-^'^'^ = 2*10-^*0^. 

We also have (t^+^ - tf ) + (t? - t^) > 1 - 10-(™+2) + (0.9 - 1.1) > 0.7. Thus, we have 
ET=i {(4 - 4"') - (4 - 4~')} < 2 * 10-2 * gig < 0.7 < (C+i - tf) + (t? - tO). This shows 
that we can construct an infinite cycle in between l^ and l^ for all the values in our chosen inter- 
vals, and hence that {l^,x = y = 0) G RobWinTimeDivi(n(-i/^)). Observe that {l^,x = y = I) ^ 
RobWinTimeDivi(n(^/3)) 

We next show that {l^,x = y = 0) ^ JRWinTimeDiv^^' '(□(-i/"3)) for any ej > 0. Observe that for 

any objective <P, we have JRWinTimeDiv^^' '(#) C JRWinTimeDiv^^' (c^). Let ej = e and let e^ = 0. 
Consider any player-1 e-jitter 0-response time strategy vri that makes the game cycle in between 
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fi and l^. Player 2 then has a strategy which "jitters" the player-1 moves by e. Thus, the player-1 
strategy tti can only propose a\ moves with the value of x being less than or equal to 1 — e (else the 
jitter would make the move invalid). Thus, player 2 can ensure that t\ — t-[~ < 1 — e for all j for some 
run (since x has the value t\ — 1\ when a\ is taken for the j'-th time for j > 0). We then have that 
for any player-1 e-jitter 0-response time strategy, player 2 has a strategy such that for some resulting 

run, we have t\ — t-[ < 1 — e and t2 ~ ^2^ > 1- Thus, Yl^Li \ (^2 ~ ^2~ ) ~ (^1 ~ ^i~ ) f > "t- * £> 
which can be made arbitrarily large for a sufficiently large m for any e and hence greater than 
(t™+^ - tf ) + (t? -4) <1 + (tl - 4) for any initial values of t? and t^. This violates the requirement 
for an infinite f, l^ cycle. Thus, {f,x = y = 0) ^ JRWinTimeDiv^'°(n(^Z3^^ £q^ ^^^^y ^^q g 



Theorem 7. Let 7 be a timed automaton and (p an objective. For all Sj > and e^ > 0, we 
have JRWinTimeDiv^^' '{(p) C RobWinTimeDivi(<^) C WinTimeDivi((^). All the subset inclusions 
are strict in general. 

Sampling semantics. Instead of having a response time for actions of player 1, we can have a 
model where player 1 is only able to take actions in an Sj interval around sampling times, with a 
given time period ^sample- A timed automaton can be constructed along similar lines to that of T'^J'^' 
to obtain the winning set. 
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5 Appendix 

Representing regions. A region of a timed automaton game 7 can be represented as a tuple 
R = {I, h,V{C)) where (a) / is a location of T; (b) /i is a function which specifies the integer values 
of clocks h : C ^ (IN n [0, M]) (M is the largest constant in T); and (c) V{C) is a disjoint partition 
of the clocks {C_i, Co, ■ ■ -Cn \ WCj = C, Q 7^ for i > 0}. Then, a state s with clock valuation 
K is in the region corresponding to R when all the following conditions hold: (a) the location of 
s corresponds to the location of R; (b) for all clocks x with k{x) < Cx, Ik{x)\ = h{x); (c) for 
k{x) > Cx, h{x) = Cx] (d) for all pair of clocks {x,y), with k(x) < Cx and K{y) < Cy, we have 
frac(K(a;)) < frac(K(y)) iff x G Cj and y € Cj with < i < j (so, x,y ^ Ck with k > implies 
frac(K(a;)) = frac(K(y))); (e) for k{x) < Cx, frac(K(x)) = iff x G Co; and (f) x G (7_i iff k{x) > Cx- 

Proof of Lemma 3. 

Let us denote the region R by {li, tick, bli, h, ((7_i, Co, . . . , C„)) according to the representation 
mentioned above. When time elapses, the sets Co,...,C„ move in a cyclical fashion, i.e., 
mod n + 1. The displacement mod n + 1 indicates the relative ordering of the fractional sets. A 
movement of a "full" cycle of the displacements increases the value of the integral values of all the 
clocks by 1. We also only track the integral value of a clock x G C upto Cx, after that the clock is 
placed into the set C_i. Note that the extra clock z introduced in T is never placed into C_i, and 
always has a value mod 1. Let us order the clocks in C in order of their increasing Cx values, i.e., 
Cxi ^ Cx2 < • • • Cxpf where N = C. The most number of time successors are obtained when all clocks 
have an integral value of to start with. We count the number of time successors in N stages. In 
the first stage, C_i = 0. After at most Cxi full cycles, the clock xi gets moved to C_i as its value 
exceeds the maximum tracked value. For each full cycle, we also have the number of distinct mod 
classes to be A^ -|- 1 (recall that we also have the extra clock z). We need another factor of 2 to 
account for the movement which makes all clock values non-integral, e.g., {x = l,y = 1.2, z = 0.99) 
to {x = 1.00001, y = 1.20001,2; = 0.99001). Thus, before the clock Cx^ gets moved to C_i, we can 
have 2 • (cxi + 1) • (A^ + 1) time successors. In the second stage, we can have at most Cx2 + 1 — Cxi before 
clock Cx2 gets placed into C_i. Also, since xi is in C_i, we can only have A^ -|- 1 — 1 mod classes 
in the second stage. Thus, the number of time successors added in the second stage is at most 
2 • {cx2 +^ — Cxi)-N. Continuing in this fashion, we obtain the total number of time successors as 2 • 
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:c,, + i)-(iv + i) + (c,, + i-c,j.(iv + 1-1) + ■• . + (0,^ + 1 -E.=T'c,J-(iv + i-(iv-i))) 

Construction of the finite turn based game T^. 

The game T-'^ consists of a tuple {S^ ,E^ , S'l , 5*2 ) where, 

— S'^ = Si U S2 is the state space. The states in S*/ are controhed by player-i for i € {1, 2}. 

— 5( = SReg X {1}, where S'peg is the set of regions in 7. 

- S[ = ^Tup X {2}. 

The set S'jup wih be described later. Intuitively, a 5 G S'jup represents a 3-tuple {Yi,Y2,ai) 
where Yi are regions of T, such that {A, oi) G A(s) with s'+ Z\ E Y2. The values of ^2 and ai 
are maintained indirectly. 

- Sjup = L X {true, false}^ X H X ViC) x {0, . . . , M} x {0, . . . , |(7| + 1} x {true, false} x Lx 
2^ X {true, false}, where H is the set of valuations from C to positive integers such that each 
clock X is mapped to a value less than or equal to Cx where Cx is the largest constant to which 
clock X is compared to. 

Given Z = (^1, iicA:, 6/1, /i, (C_i, . . . , C„), A;, tt), om, ^2, A, ieu) € S'jup, we let FirstRegion(Z) de- 
note the region {I2, tick, bli,h,{C^i, ... ,Cn)) G SReg- Intuitively, FirstRegion(Z) is the region 
from which player 1 first proposes a move. The move of player 1 consists of a intermediate region 
Y, denoting that first time passes to let state change from FirstRegion(Z) to Y; and a discrete 
jump action specified by a destination location I2, together with the clocks to be reset, A (we 
observe that the discrete actions may also be directly specified as ai € Ai in case |^i| < |L| -2 ). 
The variable tev is true iff player 1 proposed any relinquishing time move. The region Y is ob- 
tained from Z using the variables < k < M, < w < |C| + 1, and om E {true, false}. The 
integer w indicates the the relative movement of the clock fractional parts Cq, . . . Cn (note that 
the movement must occur in a cyclical fashion). The integer k indicates the number of cycles 
completed. It can be at most M because after that, all clock values become bigger that the 
maximum constant, and thus need not be tracked. The boolean variable om indicates whether 
a small e-move has taken place so that no clock value is integral, eg., (x = 1, y = 1.2, z = 0.99) 
to (x = 1.00001, y = 1.20001, z = 0.99001). 
Formally, Second Region (Z) denotes the region {I2, tick' , bli, h' , {C'_i, . . . , C^)) G SReg where 

{h{x) + k if h{x) + k < Cx and x G Cj with j + w < n; 

h{x) + A; + 1 if h{x) + /c + 1 < Cx and x G Cj with j + w > n; 
Cx otherwise. 

The integer k indicates the number of integer boundaries crossed by all the clocks when 
getting to the new region. Some clocks may cross k integer boundaries, while others may 
cross k + 1 integer boundaries. 

, ( \ _ \ h{x) + k if X G Cj with j + w <n; 

maxv "j^ h{x) + k +\ if X G Cj with j + w > n. 

(/ijnax will be used later in the definition of fl^^-) 

. (Cii, ...,C'J= /Compact o /^— ° /.^^InMove ° /cycle((C-l, • • • , C„)), where 
* /cyc,e((C^-l, ■■■,Cn)) = {C^1,C^, • • • , C,',) with C[^_^^^ ^„, („+y = C,. 

This function cycles around the fractional parts by w. 
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fom ( l(-i (^ (^ \\ _ \ (C^-1) C^O) • • • ) Cn) il om — FALSE; 

/OpenMoveU^-1' Oq, • • • , 0„; J - <^ (C_i, 0, Cq, • • • , C'„) if Om = TRUE. 

This function indicates if the current region is such that all the clocks have non-integral 

values (if om = true). 

/max((C_i, Co, . . . , C„)) = (Cii, C^, . . . , C;) with q = C, \ Vj for J > and C^ = 

C-i ^j=Q Vj where (a) x € Vq iff x G Co and /imax(a;) > c^; and (b) x £ Vj for j > iff 

X G Cj and /;.'(x) = Cx- 

When clocks are cycled around, some of them may exceed the maximal tracked values 

Cx- In that case, they need to be moved to C_i. This function is accomplished by /max- 

/compact ((C_i, Cq, . . . , Cm)) eliminates the empty sets for j > 0. It can be obtained by 

the following procedure: 

i:=0,j:=l 
^vhile j < m do 

while j < m and Cj = do 

j := J + 1 
end ^vhile 
if Cj ^ then 

Cj+i := Cj 

i:=i + l,j ■■= j + 1 
end if 
end while 
return (C_i, Cq, . . . , Q) 



tick' = TRUE iff /c > 0; or z G C,- and w > n 



I. 



The set of edges is specified by a transition relation 6^ , and a set of available moves F^ . We let 
Aj denote the set of moves for player-i, and ri{X) denote the set of moves available to player-i 
at state X (^ S- . 

4 = (5Reg X L X 2^ U {±i}) X {!}. 

The component 5'Reg denotes the region that player 1 wants to let time elapse to in T to before 
she takes a jump with the destination specified by the location and the set of clocks that are 
reset. The move {J-i} x {1} is a relinquishing move, corresponding to a pure time move in T. 
AI = SReg X {1, 2} X L X 2'^ X {2}. 

The component S'peg denotes the region that player 2 wants to let time elapse to in T to before 
she takes a jump with the destination specified by the location and the set of clocks that are 
reset. The element in {1,2} is used in the case player 2 picks the same intermediate region S'peg 
as player 1. In this case, player 2 has a choice of letting the move of player 1 win or not, and 
the number from {1,2} indicates which player wins. 

The set of available moves for player 1 at a state {X, 1) is given by r( {X x {1}) = {J-i} x {1} U 
3s = {lx,Kx) G X, 3(Z\,_L) G -fi(s) such that {lx,Kx) + A £Y and 1 
37 G Y, 3{lx,ai,e,ly,X) G fi(s'), such that 7 '^ 9 J 

The set of available moves for player 2 at a state {X,2) is given by rf {X x {2}) = 
iG{l,2}, 3s = {lx,Kx) GFirstRegion((X,2)), 3{A,±2) e his) ] 
such that {lx,Kx) + A &Y and 

(a) ly = Ix and A = or, 

(b) 37 (£Y 3{lx, a2, B, ly, A) G r2(s') such that 7^9 

20 



(y,/„A,i) 



{Y,i,ly,X,2) 



— The transition function S^ is specified by 

. 6f{{l, tick, bh, h, {C-i, ...,Cn),l), {Y, ly, A, 1)) = 

{I, tick, bli, h, {C-i, ... ,Cn),k,w, om,ly, X,FAhSE, 2), where < k 

M, < w < \C\ + I, om G {true, false} are such that Y 
SecondRegion((/, tick, bli, h, (C_i, . . . ,C„), k,w, om,ly,X, false, 2)). 

. Sfiil, tick, bh, h, (C_i, ...,Cn),l), {±, 1)) = 

(/, tick, bli,h, (C_i, . . . ,C„),0, 0, FALSE, Z,0, TRUE, 2). 
• Let {Z,2) = {I, tick, bli, h, (C_i, . . . , C„), k,w, om,lz, Xz, tev,2)). 

Then, 6f{{Z,2),{Y,2,l 
' (Second Region (Z)[loc : 



< 



ly , Ay, I)) -■ 
^2) ^2 



0, Ml 



_ i^\ioc := ly, Xy := 0, bli 
6f{{Z,2),{Y,l,ly,Xy,2))-- 
(SecondRegion(Z)[loc := 



Iz, X 



false], f) 
: 0, bh 



(SecondRegion(Z)[loc := 



^2) ^2 



0,bh 



{Y[loc:=ly,X 



y, ^vy 



0,bh 



false],!) 



= true], 1) if tev = false and all player 1 
moves to Second Region (Z) 
beats all player 2 moves to Y 
from the region FirstRegion(Z) 
according to Lemma 2; 
otherwise. 

true], 1) if tev = FALSE and all player 1 
moves to Second Region (Z) 
beats all player 2 moves to Y 
from the region FirstRegion(Z) 
according to Lemma 2; 

= true], 1) if tev = FALSE and 

Y = SecondRegion(Z) ie., both 
players pick the same time delay, 
(and player 2allows the player 1 move, 
signified by the 1 m{Y,l,ly,Xy,2)); 
otherwise.. 



Note that we change the values of bh and tick only after player-2 moves. 

Complexity of reduction. 

Let l^il* = min{|y4j|,L • 21*-^!} for i € {1,2}. In the construction of 7^ , we can keep track of 
actions, or the locations together with the reset sets depending on whether \Ai\ is bigger than 
L ■ 2l^l or not. We have \S(\ = |^Reg|, and |5(| = |5Reg| • (M + 1) • (|C| + 2) • 2 • (|^i|* + 1) 
(we have incorporated a modification where we represent possible actions by {J-i} U Ai instead of 
L X 2 X {true, false}). Given a state Z £ S(, the number player-1 edges from Z is equal to 
one plus the cardinality of the set of time successors of Z multiplied by player-1 actions. This is 
equal to (|^i| + 1)* • ((M + 1) • (|C| + 2) • 2) (the +1 corresponds to the relinquishing move). Thus 
the total number of player-1 edges is at most |5Reg| • {\Ai\* + 1) • ((M + 1) • (|C| + 2) • 2). Given 
a state X G 5*2, the number player-2 edges from X is equal to 2 • (IA2I* -|- 1) multiplied by the 
cardinality of the set of time successors of FirstRegion(X) (the plus one arises as player-2 can have 
a pure time move in addition to actions from A2). Thus, the number of player-2 edges is at most 
|5|| • 2 • (1^21* + 1) • ((M + 1) • (|C| + 2) • 2). Hence, \Ef\ < |5Reg| • ((M + 1) • (|C| + 2) • 2) • {\Ai\* + 
1) [(1 + (1^21* + 1) • {{M + 1) • (|C| + 2) • 2)]. Let |1constr| denote the length of the clock constraints 
in T. For our complexity analysis, we assume all clock constraints are in conjunctive normal form. 
For constructing T-^, we need to check whether regions satisfy clock constraints from 7. For this. 
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we build a list of regions with valid invariants together with edge constraints satisfied at the region. 
This takes 0(|5Reg| • |Tconstr|) time. We assume a region can be represented in constant space. 
Proof of Theorem 3 
. From [f8], we have that a turn based parity game with m edges, n states and 



1 , 



Tr 



d parity indices can be solved in 0{m ■ n3 + 2) time. Thus, WinTimeDiv^ (Parity(i7)) 



d+2 



can be computed in time O I ([S'pegl • jTconstrl) + J^i • ^2 ^ ^ )' where J^i = \SReg\ 

((M + f) • (1C| + 2) • 2) • (l^il* + 1) [(1 + (1^21* + 1) • {{M + 1) ■ {\C\ + 2) • 2)], and J^2 = |^Reg| 
(1 + (M + f) • (|C| + 2) • 2 • (1^1 1* + 1)), which is equal to 



O (|5Regl • iTconstrl) + [M ■ \C\ ■ {A^l*] ■ 2 • j^Regl ■ M ■ \C\ ■ \A 



d+2 I 3 
3^2 



D 

We now present an extension for Lemma 1. 

Lemma 4. Let 7 be a timed automaton game and T be the corresponding enlarged game structure. 
Let $ be an lo -regular region objective of 7. If tti is a region strategy that is winning for $ from 
Win^^ {(p) and vr™'^ is a robust strategy that is region- equivalent to tti, then Tr^"*^ is a winning strategy 
for <P from \N\nJ{<P). 

Proof. Consider any strategy 7r2 for player 2, and a state s G Wiri]^ (^). We have Outcomes(s, tt'^^, vr2) 
to be the set of runs r such that for all A; > 0, either a) 7r™'^(r[0..fc]) = (Z\,_Li) and r[k + 1] = 
?jd(r[fc],(Z\,±i),7r2(r[0..A;])) or,7r^°^r[0..fc]) = ([a,/3],ai) andr[fc+l] =?jd(r[fc],(Z\,ai),7r2(r[0..A;])) 
for some A € [a,/3]. It can be observed that Outcomes(s,7r^°'^, 7r2) = |J^/ Outcomes(s, vr^, 7r2) where 
tt[ ranges over (non-robust) player-1 strategies such that for runs r G Outcomes(s, vr^, 7r2) and for 
aU A; > we have 7r;(r[0..A;]) = {A, ±i) if 7r[°^{r[0..k]) = (Z\,±i), and <(r[0..fc]) = {A,ai) if 
tt'^ {r[0..k]) = {[a,(3],ai) for some A € [a,/3]; and vr^ acts like tti otherwise (note that the runs 
r and the strategies tt^ are defined inductively with respect to k, with r[0] = s). Each player-1 
strategy tt[ in the preceeding union is region equivalent to vri since 7rJ° is region equivalent to vri 
and hence each tt[ is a winning strategy for player 1 by Lemma 1. Thus, Outcomes(s,7rJ°'',7r2) = 
U^/ Outcomes(s', 7ri,7r2) is a subset of <P, and hence vr™'' is a winning strategy for player 1. D 
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